Graph Neural Networks (GNNs) have been successfully applied in many applications in computer sciences. Despite the success of deep learning architectures in other domains, deep GNNs still underperform their shallow counterparts. There are many open questions about deep GNNs, but over-smoothing and over-squashing are perhaps the most intriguing issues. When stacking multiple graph convolutional layers, the over-smoothing and over-squashing problems arise and have been defined as the inability of GNNs to learn deep representations and propagate information from distant nodes, respectively. Even though the widespread definitions of both problems are similar, these phenomena have been studied independently. This work strives to understand the underlying relationship between over-smoothing and over-squashing from a topological perspective. We show that both problems are intrinsically related to the spectral gap of the Laplacian of the graph. Therefore, there is a trade-off between these two problems, i.e., we cannot simultaneously alleviate both over-smoothing and over-squashing. We also propose a Stochastic Jost and Liu curvature Rewiring (SJLR) algorithm based on a bound of the Ollivier's Ricci curvature. SJLR is less expensive than previous curvature-based rewiring methods while retaining fundamental properties. Finally, we perform a thorough comparison of SJLR with previous techniques to alleviate over-smoothing or over-squashing, seeking to gain a better understanding of both problems.

移动对象检测（MOD）是许多计算机视觉应用程序的基本步骤。当从静态或移动的摄像机捕获的视频序列遇到挑战时，MOD变得非常具有挑战性：伪装，阴影，动态背景和照明变化，仅举几例。深度学习方法已成功地应用于竞争性能。但是，为了解决过度拟合的问题，深度学习方法需要大量标记的数据，这是一项艰巨的任务，因为始终无法提供详尽的注释。此外，某些MOD深度学习方法显示了在看不见的视频序列存在下的性能下降，因为在网络学习过程中涉及相同序列的测试和训练分裂。在这项工作中，我们使用图形卷积神经网络（GCNN）提出了MOD作为节点分类问题的问题。我们的算法被称为GraphMod-NET，包括实例分割，背景初始化，特征提取和图形结构。在看不见的视频上测试了GraphMod-NET，并且在无监督，半监督和监督的学习中，在2014年变更检测（CDNET2014）和UCSD背景减法数据集中的最先进方法进行了测试。

移动对象检测是计算机愿景中的讨论的核心主题，适用于自动驾驶汽车，视频监控，安全和执法中的广泛应用。神经形态视觉传感器（NVS）是生物启发传感器，用于模仿人眼的工作。与传统的基于帧的相机不同，这些传感器捕获异步'事件'流，其在前者上呈现多个优点，如高动态范围，低延迟，低功耗和减少的运动模糊。然而，这些优点成本高，因为事件相机数据通常包含更多噪声并具有低分辨率。此外，由于基于事件的相机只能捕获场景的亮度的相对变化，事件数据不包含来自普通摄像机的视频数据中的通常可视信息（如纹理和颜色）。因此，在基于事件的相机中移动对象检测成为一个极具挑战性的任务。在本文中，我们介绍了一种无监督的曲线谱聚类技术，用于在基于事件的数据中移动对象检测（GSceVentMod）。我们还展示了如何自动确定最佳的移动物体数量。公开数据集上的实验比较表明，所提出的GSceventMod算法优于最大限度的最新技术，最大余量为30％。

Convolutional Neural Networks (CNNs) have demonstrated superiority in learning patterns, but are sensitive to label noises and may overfit noisy labels during training. The early stopping strategy averts updating CNNs during the early training phase and is widely employed in the presence of noisy labels. Motivated by biological findings that the amplitude spectrum (AS) and phase spectrum (PS) in the frequency domain play different roles in the animal's vision system, we observe that PS, which captures more semantic information, can increase the robustness of DNNs to label noise, more so than AS can. We thus propose early stops at different times for AS and PS by disentangling the features of some layer(s) into AS and PS using Discrete Fourier Transform (DFT) during training. Our proposed Phase-AmplituDe DisentangLed Early Stopping (PADDLES) method is shown to be effective on both synthetic and real-world label-noise datasets. PADDLES outperforms other early stopping methods and obtains state-of-the-art performance.

We present a novel neural model for modern poetry generation in French. The model consists of two pretrained neural models that are fine-tuned for the poem generation task. The encoder of the model is a RoBERTa based one while the decoder is based on GPT-2. This way the model can benefit from the superior natural language understanding performance of RoBERTa and the good natural language generation performance of GPT-2. Our evaluation shows that the model can create French poetry successfully. On a 5 point scale, the lowest score of 3.57 was given by human judges to typicality and emotionality of the output poetry while the best score of 3.79 was given to understandability.

We present a novel approach to generating news headlines in Finnish for a given news story. We model this as a summarization task where a model is given a news article, and its task is to produce a concise headline describing the main topic of the article. Because there are no openly available GPT-2 models for Finnish, we will first build such a model using several corpora. The model is then fine-tuned for the headline generation task using a massive news corpus. The system is evaluated by 3 expert journalists working in a Finnish media house. The results showcase the usability of the presented approach as a headline suggestion tool to facilitate the news production process.

We present a method for extracting a multilingual sentiment annotated dialog data set from Fallout New Vegas. The game developers have preannotated every line of dialog in the game in one of the 8 different sentiments: \textit{anger, disgust, fear, happy, neutral, pained, sad } and \textit{surprised}. The game has been translated into English, Spanish, German, French and Italian. We conduct experiments on multilingual, multilabel sentiment analysis on the extracted data set using multilingual BERT, XLMRoBERTa and language specific BERT models. In our experiments, multilingual BERT outperformed XLMRoBERTa for most of the languages, also language specific models were slightly better than multilingual BERT for most of the languages. The best overall accuracy was 54\% and it was achieved by using multilingual BERT on Spanish data. The extracted data set presents a challenging task for sentiment analysis. We have released the data, including the testing and training splits, openly on Zenodo. The data set has been shuffled for copyright reasons.

Word order, an essential property of natural languages, is injected in Transformer-based neural language models using position encoding. However, recent experiments have shown that explicit position encoding is not always useful, since some models without such feature managed to achieve state-of-the art performance on some tasks. To understand better this phenomenon, we examine the effect of removing position encodings on the pre-training objective itself (i.e., masked language modelling), to test whether models can reconstruct position information from co-occurrences alone. We do so by controlling the amount of masked tokens in the input sentence, as a proxy to affect the importance of position information for the task. We find that the necessity of position information increases with the amount of masking, and that masked language models without position encodings are not able to reconstruct this information on the task. These findings point towards a direct relationship between the amount of masking and the ability of Transformers to capture order-sensitive aspects of language using position encoding.

人类和神经语言模型都能够执行主题 - 动词数协议（SVA）。原则上，语义不应干扰此任务，这仅需要句法知识。在这项工作中，我们测试含义是否干扰了各种复杂性的句法结构中的英语一致性。为此，我们同时生成语义上良好的和荒谬的项目。我们将Bert Base与人类的表现进行了比较，该表现是通过心理语言在线众包实验获得的。我们发现伯特和人类都对我们的语义操纵敏感：出现荒谬的项目时，它们的频率更高，尤其是当它们的句法结构具有吸引子（主题和动词之间的名词短语和与该数字不同的名词短语）时主题）。我们还发现，有意义性对SVA错误的影响对于BERT而言比对人类的影响更强，显示前者对这项任务的词汇敏感性更高。

基于草图的图像检索（SBIR）是检索与语义和手绘草图查询的空间配置相匹配的自然图像（照片）的任务。草图的普遍性扩大了可能的应用程序的范围，并增加了对有效SBIR解决方案的需求。在本文中，我们研究了经典的基于三胞胎的SBIR解决方案，并表明对水平翻转（即使在模型登录之后）的持续不变性也损害了性能。为了克服这一限制，我们提出了几种方法，并深入评估它们每个方法以检查其有效性。我们的主要贡献是双重的：我们提出并评估几种直观的修改，以构建具有更好的翻转均衡性的SBIR解决方案。我们表明，视觉变压器更适合SBIR任务，并且它们的优于CNN的优于较大的CNN。我们进行了许多实验，并引入了第一个模型，以优于大规模SBIR基准（粗略）的人类表现。与以前的最新方法相比，我们的最佳模型在粗略的基准测试中达到了62.25％（在k = 1）的召回率为46.2％。